Take a look around the absolutely stunning Cathedral. Various parts of the Cathedral were used as Hogwarts Castle in the Harry Potter films.
The docks is also worth a look; boat journeys down the Gloucester and Sharpness Canal are available every other hour in summer time
